Regularized extreme learning machine for regression with missing data
نویسندگان
چکیده
This paper proposes a method which is the advanced modification of the original Extreme Learning Machine with a new tool to solve the missing data problem. It uses a cascade of L1 penalty (LARS) and L2 penalty (Tikhonov regularization) on ELM to regularize the matrix computations and hence make the MSE computation more reliable, and on the other hand, it estimates the expected pairwise distances directly on incomplete data so that it offers the ELM a solution to solve the missing data issues. According to the experiments on 9 data sets, the method shows its significant advantages: fast computational speed, no parameter need to be tuned and it appears more stable and reliable generalization performance by the two penalties, Moreover, it completes ELM with a new tool to solve missing data problem even when half of the training data are missing as the extreme case.
منابع مشابه
Machine Learning Models for Housing Prices Forecasting using Registration Data
This article has been compiled to identify the best model of housing price forecasting using machine learning methods with maximum accuracy and minimum error. Five important machine learning algorithms are used to predict housing prices, including Nearest Neighbor Regression Algorithm (KNNR), Support Vector Regression Algorithm (SVR), Random Forest Regression Algorithm (RFR), Extreme Gradient B...
متن کاملRegularized Committee of Extreme Learning Machine for Regression Problems
Extreme learning machine (ELM) is an efficient learning algorithm for single-hidden layer feedforward networks (SLFN). This paper proposes the combination of ELM networks using a regularized committee. Simulations on many real-world regression data sets have demonstrated that this algorithm generally outperforms the original ELM algorithm.
متن کاملA Hybrid Machine Learning Method for Intrusion Detection
Data security is an important area of concern for every computer system owner. An intrusion detection system is a device or software application that monitors a network or systems for malicious activity or policy violations. Already various techniques of artificial intelligence have been used for intrusion detection. The main challenge in this area is the running speed of the available implemen...
متن کاملExtreme Support Vector Regression
Extreme Support Vector Machine (ESVM), a variant of ELM, is a nonlinear SVM algorithm based on regularized least squares optimization. In this chapter, a regression algorithm, Extreme Support Vector Regression (ESVR), is proposed based on ESVM. Experiments show that, ESVR has a better generalization ability than the traditional ELM.Furthermore, ESVMcan reach comparable accuracy as SVR and LS-SV...
متن کاملApplying machine learning techniques to ecological data
This thesis is about modelling carbon flux in forests based on meterological variables using modern machine learning techniques. The motivation is to better understand the carbon uptake process from trees and find the driving factors of it, using totally automated techniques. Data from two British forests were used, (Griffin and Harwood) but finally results were obtained only with Harwood becau...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Neurocomputing
دوره 102 شماره
صفحات -
تاریخ انتشار 2013